Generating Verbal and Nonverbal Utterances for Virtual Characters
نویسندگان
چکیده
We introduce an approach to multimodal generation of verbal and nonverbal contributions for virtual characters in a multiparty dialogue scenario. This approach addresses issues of turn-taking, is able to synchronize the different modalities in real-time, and supports fixed utterances as well as utterances that are assembled by a full-fledged treebased text generation algorithm. The system is implemented in a first version as part of the second VirtualHuman demonstrator.
منابع مشابه
Cerebella: Automatic Generation of Nonverbal Behavior for Virtual Humans
Our method automatically generates realistic nonverbal performances for virtual characters to accompany spoken utterances. It analyses the acoustic, syntactic, semantic and rhetorical properties of the utterance text and audio signal to generate nonverbal behavior such as such as head movements, eye saccades, and novel gesture animations based on co-articulation.
متن کاملNon-verbal Communication for Correlational Characters
Social interaction is a key element of modern virtual environments. This paper discusses how non-verbal communication (or body language) is vital to real world social interaction, and how it is important to carry it over to virtual environments. It is not sufficient for a character to passively exhibit non-verbal communication; non-verbal communication should be a genuine interaction between a ...
متن کاملIntonational patterns of nonverbal vocalizations in people with dementia.
Nonverbal vocalizations in dementia are important clinically since they generally have been regarded as disruptive behavior that is disturbing. The aim of the present study is to describe the interactional pattern, including the prosodic package, of nonverbal vocalizations in a participant in a late stage of dementia. The acoustic analysis shows that the vocalizations do not differ significantl...
متن کاملModel-based Animation of Coverbal Gesture
Virtual conversational agents are supposed to combine speech with nonverbal modalities for intelligible and believeable utterances. However, the automatic synthesis of coverbal gestures still struggles with several problems like naturalness in procedurally generated animations, flexibility in pre-defined movements, and synchronization with speech. In this paper, we focus on generating complex m...
متن کاملBelievable Virtual Characters in Human-Computer Dialogs
For many application areas, where a task is most naturally represented by talking or where standard input devices are difficult to use or not available at all, virtual characters can be well suited as an intuitive man-machineinterface due to their inherent ability to simulate verbal as well as nonverbal communicative behavior. This type of interface is made possible with the help of multimodal ...
متن کامل